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Abstract 

In  the  past  12  months,  we  have  been  focusing  our  effort  on  three  projects:  the  first  one  is  about  numerical 
solutions  of  optimal  control  problems  using  the  analysis  of  variance  (ANOVA)analysis;  the  second  one  is 
error  analysis  for  stochastic  partial  differential  equations  with  white  noise  forcing  terms  and  the  third  one  is 
about  efficient  Monte  Carlo  methods  using  sensitivity  derivatives.  Numerical  approximation  for  stochastic 
partial  differential  equations  is  the  common  theme  of  the  three  projects. 

In  the  first  project,  The  impact  of  parameter  dependent  boundary  conditions  on  the  solutions  of  a  class  of 
nonlinear  partial  differential  equations  (PDEs)  is  considered.  The  concepts  of  effective  dimensions  are  used 
to  determine  the  accuracy  of  the  ANOVA  expansions.  Demonstrations  are  given  to  show  that  whenever 
truncated  ANOVA  expansions  of  functionals  provide  accurate  approximations,  optimizers  found  through  a 
simple  surrogate  optimization  strategy  are  also  relatively  accurate.  Although  most  of  the  results  are  pre¬ 
sented  and  discussed  in  the  context  of  surrogate  optimization  problems,  they  also  apply  to  other  settings  such 
as  stochastic  ensemble  methods  and  reduced-order  modeling  for  nonlinear  PDEs.  In  the  second  project,  we 
study  finite  element  numerical  methods  for  class  of  nonlinear  stochastic  elliptic  partial  differential  equations 
as  well  as  stochastic  Stokes  equation  with  white  noise  forcing  terms.  Error  estimates  are  established,  the 
significance  of  these  error  estimates  is  that  they  provide  a  practical  guidance  to  the  Monte  Carlo  simulation. 
Numerical  examples  are  also  presented  to  examine  our  theoretical  results.  In  the  third  project,  we  continue 
our  research  effort  on  efficient  Monte  Carlo  simulation  for  stochastic  partial  differential  equations  using 
sensitivity  derivatives.  We  further  verified  the  efficiency  of  our  algorithm  by  combing  sensitivity  derivative 
Monte  Carlo  method  with  the  quasi-Monte  Carlo  simulation. 


Project  I:  ANOVA  expansions  and  surrogate  optimization  problems 

Consider  a  general  optimal  control  problem. 


minimize 

J  (^(q)) 

functional 

over 

a  e  A  CRd 

admissibility  set 

subject  to 

F(u\  a)  =  0 

nonlinear  PDE 

When  the  number  of  parameters  is  large  and  the  PDEs  as  constraints  are  complicated,  this  is  a  large 
scale  computational  problem.  To  reduce  the  complexity  of  computation,  we  proposal  to  find  the  numerical 
solution  of  the  optimal  control  using  the  surrogate  optimization  method.  In  the  surrogate  optimization,  We 
first  choose  N  points  belonging  to  admissible  set  A.  Then  we  solve  the  N  PDE  problems 

=  0  j  = 

and  calculate  the  N  values  Jj  =  J(u j  =  1, ...  ,N  of  the  const  function.  From  the  set  {c^j) ,  u  W)}£i, 
we  build  a  surrogate  function  JSur{&)  defined  over  the  parameter  subset  A.  The  approximation  solution  of 
the  optimal  control  problem  is  then  obtained  by  solving  the  following  surrogate  optimization  problem. 

min  JsUr(a). 
a£A 
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In  this  project,  we  will  choose  Jsur  as  polynomials  of  the  parameters  and  we  will  use  the  ANOVA  expansion 
to  determine 


•  the  parameters  that  can  be  ignored  from  the  surrogate  optimization,  and 

•  the  degree  of  the  surrogate  polynomial  function. 


Here  is  a  brief  description  of  ANOVA  expansion.  Let  P  =  {1, . . .  ,p}.  For  any  subset  of  (ordered)  coordinate 
indices  TCP,  let  |T|  denote  the  cardinality  of  T,  c?t  G  denote  the  |T|-vector  containing  the  components 
of  the  vector  a  E  Rp  indexed  by  T,  and  A ^  denote  the  |T|-dimensional  unit  hypercube  which  is  the 
projection  of  the  p-dimensional  unit  hypercube  Ap  onto  the  coordinates  indexed  by  T.  Then  Any  function 
J(a)  E  L2(AP)  may  be  written  as  the  ANOVA  expansion 

J(d)  =  Jo  4-  ^2  Jt(<*t), 

TCP 


where  the  terms  in  the  expansion  are  determined  recursively  by 


Jr{dT)  =  [ 

Jap\aI£ 


J(d)ddP\T  -  ^2  Jvi<*v)  ~  Jo 

VC  T 


starting  with 

Jo  =  f  J(a)da. 

JAp 

The  following  are  two  of  the  most  important  properties  for  ANOVA  expansion. 
•  The  ANOVA  terms  are  mutually  orthogonal,  i.e., 

JT(dT)Jv{dv)  da  =  0 


L 


Ap 

whenever  one  or  more  of  the  indices  in  T  and  V  differ. 

•  Let  T  be  a  subset  of  P  and  cr2(J)  denote  the  variance  of  a  function  J  then, 


(J)  =  y2  aT(J)i  where  <r£(J)  =  [  (Jr(ar))2 da. 

Jap 


|T|>0 

We  will  use  the  concept  of  effective  dimension  (  [])  to  determine  the  number  of  parameters  and  degree  of 
polynomials  for  the  surrogate  function. 

•  The  (effective)  superposition  dimension  of  J  (a)  is  the  smallest  integer  ps  such  that 

0<\T\<P, 

•  The  (effective)  truncation  dimension  of  J  (a)  is  the  smallest  integer  pt  such  that 

ar(J)  >  qv2(J)- 

TC{  1 . p,} 


Here  p  is  the  proportionality  close  to  1. 


If  pt  is  the  truncation  dimension,  then  only  the  first  pt  parameters  are  needed  for  the  surrogate  function.  On 
the  other  hand,  if  ps  is  the  superposition  dimension,  then  we  only  need  to  use  polynomials  with  degrees  no 
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large  than  ps.  In  [],  we  prove  the  approximation  property  of  ANOVA  expansion  under  small  perturbation 
assumption. 


To  verify  our  theoretical  analysis,  we  consider  the  following  optimal  control  problem.  The  cost  functional 
takes  the  form 


J(u)=  [  w(u)dQ  +  ?/|a|2 

J  n 


where  we  choose 


w(u)  =  (u  —  u )2  or  e^u  or  \/| u  ~  2|. 

The  state  equation  is  the  following  nonlinear  elliptic  partial  differential  equation  with  mixed  boundary 
conditions. 


—Au  +  f(u)  =  0 

in  ft 

u  =  0 

on  To 

M 

on  Ti 

i=l 

^  N 

in-  E- 
i=M+l 

on  r2, 

We  choose  q  =  0.99  in  the  superposition  dimension  and  derive,  after  computation  that, 


r  1 

if  w(u)  =  e<u-s> 

and 

f(u)  =  u2  or 

\/R 

3 

< 

if  w(u)  =  y/\u  —  u\ 

and 

f(u)  =  eu  or 

4 

if  w(u)  =  yj\u  —  u\ 

and 

<N 

II 

.  2 

otherwise 

The  above  results  indicate  that  the  effective  dimensions  depend  on  the  smoothness  of  the  cost  functionals. 
In  all  cases  we  use  quadratic  polynomials  as  surrogate  functions  and  the  errors  for  optimal  controls  are  listed 
in  Table  1.  Here  MC  is  the  Monte  Carlo  sampling,  LHS  the  Latin  hypercube  sampling  and  CVT  Centroid 
Voronoi  tessellation  sampling.  Our  numerical  results  confirm  that  When  the  effective  dimensions  are  two  or 
less,  the  quadratic  surrogate  optimization  provides  accurate  numerical  solution  for  the  optimal  controls. 


Talbe  1 :  Errors  of  optimal  controls  with  surrogate  optimizations 


sampling 

method 

i 

II 

5 

■  u )2 

w(u) 

=  \u- 

u|1/2 

/(«) 

fW 

u2 

eu 

lul1'2 

u2 

eu 

lul1/2 

MC 

0.036 

0.018 

0.086 

0.556 

0.566 

0.574 

LHS 

0.021 

0.012 

0.035 

0.378 

0.427 

0.380 

CVT 

0.067 

0.026 

0.069 

0.436 

0.433 

0.436 

Project  II:  Finite  element  approximation  for  Stochastic  Stokes  equation 

In  this  project,  we  consider  the  stochastic  Stokes  equation  with  a  white  noise  forcing  term  which  describes 
the  motion  of  an  incompressible  viscous  fluid. 


— i/Au  +  Vp 
divu 
u 


=  f  +  W,  in  ft, 
=  0,  in  ft, 

=  0,  on  dft 
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(0.1) 


where  Q  is  a  bounded  convex  domain  in  R 2  with  piecewise  continuous  boundary,  u  :  ft  — ►  R2  is  the  velocity 
of  the  fluid  flow,  p  is  the  pressure,  /  G  L2(D)  and  W  =  (W1,  W2)  is  the  white  noise  such  that 

E(Wi(x)W3(xf))  =  S(x  -  xf),  x ,  x'  G  D,  j  =  1,2 

where  £  denotes  the  usual  Delta  S  function  and  E  the  expectation.  Assume  that  G  and  D  are  the  Green’s 
functions  for  the  Stokes  equation  corresponding  to  u  and  p,  respectively.  We  define  the  weak  solution  of 
(0.1)  as  follows. 

u(x)=  [  G{x,y)f(y)dy  +  [  G(x,y)dW(y)  (0.2) 

J  n  Jn 

and 

p(x)  =  V  [  D(x,  y)f  (y)dy  +  V  [  D(x,y)dW(y)  (0.3) 

Jn  Jn 

where  the  stochastic  integral  is  defined  in  Ito’s  sense.  The  noise  term  occurs,  for  example,  when  the  fluid’s 
temperature  affects  the  flow  of  the  fluid  but  is  omitted  in  the  equation  because  of  insufficient  knowledge  of 
the  boundary  data  for  the  temperature. 


We  define  an  approximate  solution  of  (0.1)  by  discretizing  the  white  noise  W.  First  we  introduce  a  dis¬ 
cretization  for  the  white  noise.  Let  {7^}  be  a  family  of  triangulations  of  fl  (see  [?]  for  the  requirements 
on  {7^}),  where  h  G  (0, 1)  is  the  meshsize.  We  assume  the  family  is  quasiuniform,  i.e.,  there  exist  positive 
constants  p\  and  p2  such  that 

pi h  <  Rl?v  <  R%x  <  p2h ,  V  T  G  Th,  V  0  <  h  <  1,  (0.4) 

where  RiplT  and  are  the  inradius  and  the  circumradius  of  T.  Write 


z  =  7mJ r,iWM  J  =  1'2 

for  each  triangle  T  G  77t,  where  \T\  denotes  the  area  of  T.  It  is  well-known  that  is  a  family  of 

independent  identically  distributed  normal  random  variables  with  mean  0  and  variance  1  (see  [?]).  Then  the 
piecewise  constant  approximation  to  Wi(x)  is  given  by 

W3h(x)  =  £  |T|-i^Xx(x)  (0.5) 


We  consider  the  numerical  approximations  of  (??)  using  the  finite  element  method.  Denote  Pk  =  Pk(x,y) 
as  the  set  of  polynomials  of  degree  k.  Let  X  :=  (Hq(Q))2  and  Q  :=  Lq(D)  =  {q  G  L2(D),  fnq(x)dx  =  0}. 
We  approximate  the  velocity  on  each  element  T  in  7^  by  a  polynomial  of 

V(T)  =  {Pi  ©  span{Ai,  A2,  A2}}2  (0.6) 

where  A  j  are  barycentric  coordinates  defined  as 

A j  £  P\  ~  $ij  i  L  j  =  1j2 

where  ai  are  the  vertices  of  T.  Then  we  choose  the  following  finite  element  spaces. 

Xft  =  (»eC°(f!)2;  V\ TeP(T),  VTeTh,  v|en=0}, 

Qh  =  {q  e  c°(n)2;  q\TePi(T),  VTeTh}. 
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(0.7) 

(0.8) 


The  finite  element  solution  is  to  solve  the  variational  equation  in  the  finite  element  space.  Assume  that  Uh 
and  ph  are  the  finite  element  approximations  for  u  and  p,  respectively.  We  have  the  following  error  estimates. 
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Theorem  1  There  exists  a  constant  C  such  that 

Edlu-uhll2)  <C|ln/i|/i5,  (0.9) 


£(l|p-Pfcl|2-i)<<?|ln^2- 


The  significance  of  the  errors  estimates  is  that  they  provide  practical  guidance  for  the  choice  of  the  number 
of  samples  in  the  Monte  Carlo  simulation.  We  have  conducted  a  number  of  Monte  Carlo  simulations  using 
our  algorithm.  Figure  1  and  Figure  2  show  the  expectation  and  variance  of  the  velocity,  respectively. 


Figure  1  the  expectation  and  variance  of  velocity 


Conclusion  and  future  research 

We  posed  the  problem  of  optimal  control  and  design  optimization  using  the  statistical  tool  ANOVA.  Our 
numerical  experiments  indicate  that  ANOVA  expansion  combined  with  concept  of  effective  dimension  is 
effective  in  choosing  the  surrogate  functions  for  optimal  control  problems.  We  have  also  studied  numerical 
solutions  stochastic  Stokes  equations  with  white  noise  forcing  terms.  Our  error  analysis  shows  that  the  finite 
element  method  for  stochastic  Stokes  equations  has  one  order  lower  convergence  rate  than  deterministic 
problems.  Future  research  includes  ANOVA  analysis  for  optimal  control  problems  with  large  number  of 
parameters,  numerical  solutions  for  time  dependent  partial  differential  equations  with  multiplicative  noises. 
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